阅读量：

28

作者：

W Li，S Huang，Z Qiu，A Song

展开

摘要：

In reinforcement learning, the agents need to sufficiently explore the environment and efficiently exploit the existing experiences before finding the solution to the tasks, particularly in cooperative multi-agent scenarios where the state and action spaces grow exponentially with the number of agents. Hence, enhancing the exploration ability of agents and improving the utilization efficiency of experiences are two critical issues in cooperative multi-agent reinforcement learning. We propose a novel method called Generative Adversarial Imitation Learning Policy Gradients (GAILPG). The contributions of GAILPG are as follows: (a) we integrate generative adversarial self-imitation learning into the multi-agent actor-critic framework to improve the utilization efficiency of experiences, thus further assisting the policy training; (b) we design a new curiosity module to enhance the exploration ability of the agents. Experimental results on the StarCraft II micromanagement benchmark demonstrate that GAILPG surpasses state-of-the-art policy-based methods and is even on par with the value-based methods. And the ablation experiments validate the reasonability of the discriminator module and the curiosity module encapsulated in our method.

展开

关键词：

Reinforcement learning Training Monte Carlo methods History Collaboration Trajectory Task analysis

DOI：

10.1109/TG.2024.3375515